• Ambulatory vocal acoustics, temporal dynamics, and serious mental illness 

      Cohen, Alex S.; Fedechko, Taylor L.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Bernstein, Jared; Cheng, Jian; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019)
      Acoustic analysis of vocal expression offers a potentially inexpensive, unobtrusive, and highly sensitive biobehavioral measure of serious mental illness (SMI)-related issues. Despite literature documenting its use for understanding SMI, prior studies have largely ignored that vocal expression is highly dynamic within individuals over time. We employed ambulatory vocal assessment from SMI outpatients ...
    • Applying speech technologies to assess verbal memory in patients with serious mental illness 

      Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Cohen, Alex S.; Cheng, Jian; Bernstein, Jared C.; Rosenfeld, Elizabeth P.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-03-11)
      Verbal memory deficits are some of the most profound neurocognitive deficits associated with schizophrenia and serious mental illness in general. As yet, their measurement in clinical settings is limited to traditional tests that allow for limited administrations and require substantial resources to deploy and score. Therefore, we developed a digital ambulatory verbal memory test with automated ...
    • A Dynamic Method, Analysis, and Model of Short-Term Memory for Serial Order with Clinical Applications 

      Cheng, Sophia; Cohen, Alex S.; Holmlund, Terje Bektesevic; Foltz, Peter W.; Cheng, Jian; Bernstein, Jared; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-10-06)
      This study examined the robustness of a traditional memory task when moved out of controlled traditional settings. A letter recall task was designed to be self-administered via a smart-device which assessed recall by participants’ writing their responses on the device. This enabled collection of both the letter recalled and the timing of this recall such that the temporal dynamics could be examined. ...
    • Extending the usefulness of the verbal memory test: The promise of machine learning 

      Chandler, Chelsea; Holmlund, Terje Bektesevic; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-01-19)
      The evaluation of verbal memory is a core component of neuropsychological assessment in a wide range of clinical and research settings. Leveraging story recall to assay neurocognitive function could be made more useful if it were possible to administer frequently (i.e., would allow for the collection of more patient data over time) and automatically assess the recalls with machine learning methods. ...
    • The importance of loneliness in psychotic-like symptoms: Data from three studies 

      Le, Thanh P.; Cowan, Tovah; Schwartz, Elana K.; Elvevåg, Brita; Holmlund, Terje Bektesevic; Foltz, Peter W.; Barkus, Emma; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-10-19)
      Poor social connection or loneliness is a prominent feature of schizotypy and may exacerbate psychosis risk. Previous studies have examined the inter-relationships between loneliness and psychosis risk, but critically, they have largely been conducted in non-clinical samples or exclusively used laboratory questionnaires with limited consideration of the heterogeneity within schizotypy (i.e., positive, ...
    • Modeling remotely collected speech data: Applications for psychiatry 

      Holmlund, Terje Bektesevic (Doctoral thesis; Doktorgradsavhandling, 2020-01-31)
      Detecting signs of disorder from listening to spoken words is a core method in psychiatry. Traditionally the interpretation of speech depends on inherently subjective processes. By contrast, digital technology can be leveraged to detect and analyze what words are spoken, timestamp when they are uttered and quantify the manner in which they are expressed. With the use of mobile communication technology, ...
    • Moving psychological assessment out of the controlled laboratory setting: Practical challenges 

      Holmlund, Terje Bektesevic; Foltz, Peter W.; Cohen, Alex S.; Johansen, Håvard D.; Sigurdsen, Randi; Fugeli, Pål; Bergsager, Dagfinn; Cheng, Jian; Bernstein, Jared; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-03)
      Behavioral assessment using smart devices affords novel methods, notably remote self-administration by the individuals themselves. However, this new approach requires navigating complex legal and technical terrain. Given the limited empirical data that currently exists, we provide and discuss anecdotes of the methodological, technical, legal, and cultural issues associated with an implementation in ...
    • Natural Language Processing and Psychosis: On the Need for Comprehensive Psychometric Evaluation 

      Cohen, Alex S.; Rodriguez, Zachary; Warren, Kiara K.; Cowan, Tovah; Masucci, Michael D.; Edvard Granrud, Ole; Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Strauss, Gregory P. (Journal article; Tidsskriftartikkel, 2022-06-23)
      <p><i>Background and Hypothesis:</i> Despite decades of “proof of concept” findings supporting the use of Natural Language Processing (NLP) in psychosis research, clinical implementation has been slow. One obstacle reflects the lack of comprehensive psychometric evaluation of these measures. There is overwhelming evidence that criterion and content validity can be achieved for many purposes, ...
    • Predicting self-injurious thoughts in daily life using ambulatory assessment of state cognition 

      Le, Thanh P.; Moscardini, Emma; Cowan, Tovah; Elvevåg, Brita; Holmlund, Terje Bektesevic; Foltz, Peter W.; Tucker, Raymond P.; Schwartz, Elana K.; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-04-12)
      Self-injurious thoughts (SITs) fluctuate considerably from moment to moment. As such, “static” and temporally stable predictors (e.g., demographic variables, prior history) are suboptimal in predicting imminent SITs. This concern is particularly true for “online” cognitive abilities, which are important for understanding SITs, but are typically measured using tests selected for temporal stability. ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors 

      Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-11-10)
      Incoherent speech in schizophrenia has long been described as the mind making “leaps” of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual “leaps” in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity ...
    • Updating verbal fluency analysis for the 21st century: Applications for psychiatry 

      Holmlund, Terje Bektesevic; Cheng, Jian; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-02-07)
      Evaluating patients’ verbal fluency by counting the number of unique words (e.g., animals) produced in a short-period (e.g., 1–3 min) is one of the most widely employed cognitive tests in psychiatric research. We introduce new methods to analyze fluency output that leverage modern computational language technology. This enables moving beyond simple word counts to charting the temporal dynamics of ...
    • Using Automated Speech Processing for Repeated Measurements in a Clinical Setting of the Behavioral Variability in the Stroop Task 

      Holmlund, Terje Bektesevic; Cohen, Alex S; Cheng, Jian; Foltz, Peter W.; Bernstein, Jared; Rosenfeld, Elisabeth; Laeng, Bruno; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-03-04)
      The Stroop interference task is indispensable to current neuropsychological practice. Despite this, it is limited in its potential for repeated administration, its sensitivity and its demands on professionals and their clients. We evaluated a digital Stroop deployed using a smart device. Spoken responses were timed using automated speech recognition. Participants included adult nonpatients (N = ...
    • Using automated syllable counting to detect missing information in speech transcripts from clinical settings 

      Diaz-Asper, Marama; Holmlund, Terje Bektesevic; Chandler, Chelsea; Diaz-Asper, Catherine; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-07-05)
      Speech rate and quantity reflect clinical state; thus automated transcription holds potential clinical applications. We describe two datasets where recording quality and speaker characteristics affected transcription accuracy. Transcripts of low-quality recordings omitted significant portions of speech. An automated syllable counter estimated actual speech output and quantified the amount of ...
    • Validating Biobehavioral Technologies for Use in Clinical Psychiatry 

      Cohen, Alex S.; Cox, Christopher R.; Tucker, Raymond P.; Mitchell, Kyle R.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06-11)
      The last decade has witnessed the development of sophisticated biobehavioral and genetic, ambulatory, and other measures that promise unprecedented insight into psychiatric disorders. As yet, clinical sciences have struggled with implementing these objective measures and they have yet to move beyond “proof of concept.” In part, this struggle reflects a traditional, and conceptually flawed, application ...